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SYSTEM AND METHOD FOR REALTIME MESSAGING HAVING IMAGE 

SHARING FEATURE 

CROSS-REFERENCE TO RELATED APPLICATION 

[0001] Not applicable. 

STATEMENT REGARDING FEDERALLY SPONSORED RESEARCH OR 

DEVELOPMENT 

[0002] Not applicable. 

FIELD OF THE INVENTION 

[0003] The invention relates to the field of communications, and more particularly to 

a platform and techniques for initiating and conducting a realtime communications 
session, such as a realtime typed-messaging session, in which images or other media 
are shared between users in an integrated display under control of one or more of the 
message session participants. 

BACKGROUND OF THE INVENTION 

[0004] Internet-based messaging platforms have increased in popularity and use in 

recent years. That class of services often features a realtime messaging channel in 
which users may mutually view typed messages in realtime. However, commercially 
available messaging services have not integrated the sharing of image media as a 
layer or enhancement on top of the typed or other message exchange. 

[0005] More specifically, the steady proliferation of digital imaging devices such as 

digital cameras, camera-equipped cellular phones and personal digital assistants has 
made the sharing of digital images and other media a more and more common online 
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activity. Messaging users who woxild like to exchange, share and download images 
from either side of a conversation however have been unable to freely incorporate 
picture exchange within their communication experience, and certainly not as part of 
an integrated messaging tool Other problems and disadvantages exist in messaging 
technology. 

SUMMARY OF THE INVENTION 

[0006] The invention overcoming these and other problems in the art relates in one 

regard to a system and method for realtime messaging having an image-sharing 
feature, in which a sender may insert and share digital photographs or other media in a 
messaging session, such as a typed realtime message exchange. In embodiments, two 
or more users may operate a messaging client to contact each other, for example via a 
message server or other communications platform. One or more of the users may 
invite another user or users to share in an image exchange, using the messaging 
channel to accept or decline that activity. Once accepted, each participant may be 
automatically be presented with a set of digital images or other media via a viewer 
tool or other interface. In embodiments, one user may be granted control over the 
selection and playing of the images in that viewer, for instance to control the playing 
of images in a slideshow window. Users may pass control of the commonly viewed 
viewer tool between each other, or in embodiments control may be shared. In 
embodiments, participants may view, save, print or otherwise manipulate the images 
accessible to them via the viewer tool. In embodiments that tool may present remote 
pointers, notes or other interface elements or annotations on or associated with the 
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images. Out-of-order rendering and other optimizations may be used to enhance 
response times for participating viewers. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0007] Fig. 1 illustrates a network in which a messaging platform may operate, 

according to embodiments of the invention. 

[0008] Fig. 2 illustrates a messaging session with an image sharing feature, carried 

out according to an embodiment of the invention. 

[0009] Fig. 3 illustrates a messaging session with an image sharing feature with an 

illustrative image selected and displayed, according to embodiments of the invention. 

[0010] Fig. 4 illustrates a messaging session with control privileges passed to another 

participant, according to an embodiment of the invention. 

[001 1] Fig. 5 illustrates a flowchart of overall image sharing and message processing, 

according to an embodiment of the invention. 



DETAILED DESCRIPTION OF EMBODIMENTS 
[0012] Fig. 1 illustrates an overall network architecture in which a system and method 

for realtime messaging may operate, according to an embodiment of the invention. 
As illustrated in that figure one or more users in a set of users 102 may use personal 
computers, workstations, personal digital assistants, network-enabled cellular 
telephones or other clients or devices to communicate with each other via a network 
104. Network 104 may be, include or interface to, for example, the Internet, an 
intranet, a local area network (LAN) or other local or remote network. Those users 
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may execute a messaging client 108, for example a messaging service such as 
Microsoft Network (MSN) Messenger. In embodiments other available services such 
as Internet relay chat (IRC), ICQ (I seek you) or others may be used. Other clients, 
services or channels, using for instance a graphical user interface, command line 
interface, voice-activated or other interface, may be used to perform or support 
messaging functions. 

[0013] More particularly and as shown in Fig. 1, two or more users in the. set of users 

102 may commimicate via network 104 and in embodiments contact a message server 
106 to exchange typed, voice or other messaging, for example in a mutually viewed 
chat panel or other realtime or near-realtime channel. The communication may be 
carried out on various ports or other interfaces, for instance using transfer control 
protocol/Intemet protocol (TCP/IP), session initiation protocol (SIP), session 
initiation protocol for instant messaging and presence logical extensions (SIMPLE) or 
other protocols or resources. According to the invention in one regard, the 
participating users in the set of users 112 may furthermore share, view and otherwise 
manipulate a set of shared images 112, such as digital photographs in joint 
photographic experts group (JPG) or other format. 

[0014] In embodiments the set of shared images 112 may be transmitted into the 

realtime commxmications channel deployed in the invention, directly from one or 
more client machines from within the set of users 102 in peer-to-peer fashion. In 
embodiments images or other media may also be accessed or served from remote 
servers or other storage sites or resources. According to embodiments of the 
invention, control over the display of the set of shared images 112 may be exercised 
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or maintained by at least one participating user, for instance by passing control object 
110 to that user to establish viewing control. In embodiments the control object 1 10 
may be voluntarily exchanged from one of the set of users 102 to another, in baton, 
round-robin or other fashion. Different control-sharing schemes may be used. 

[0015] As illustrated in Fig. 2, an image-sharing session according to an embodiment 

of the invention may be initiated via the messaging client 108. That session may be 
initiated, as illustrated, via a typed message within a dialog tool 114, such as a 
dynamic window displaying typed messages between users in scrolling or other 
fashion. As shown one user may invite another user to participate in an image- 
sharing session in dialog tool 114, which invitation the other user may accept via the 
dialog tool 1 14 or other response. Once accepted, a notification may be displayed to 
the user making the invitation that the invitation has been accepted. Upon acceptance, 
the messaging client 108 may automatically open a selector tool 1 16 and viewer 1 18, 
to select and mutually display a set of shared images 1 12 to the participating users in 
the set of users 102. Again in embodiments, the participating users may be or include 
two or more users, subscribers or other connected parties. 

[0016] Once activated, the viewer 118 may prompt the user who initiated the image- 

sharing session to click or activate the selector tool 116 to insert images into the 
mutually viewed session, or to pass control to the other one or more participating user. 
In embodiments the objects picked or selected by selector tool 1 16 may be or include, 
for example, digital photographs such as images in JPG, TIFF (tagged image format 
file) or other formats stored on the initiating user's machine. It will be appreciated 
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that in embodiments other media types may be combined or separately added or 

manipulated to share, such as video clips, audio samples or others. 

[0017] After the user having control has selected the images or other media they wish 

to share, they may click or activate a "Send" button or other interface element in 
selector tool 116 or otherwise to transmit the set of shared images 112 to the other 
user. Once sent, the set of shared images 1 12 may be communicated via network 104 
to the other user or users, for instance via message server 106. In embodiments the 
set of shared images 112 may be communicated between users using different 
channels or protocols than those supporting the typed messages or other content of 
dialog tool 1 14. Other communication architectures are possible. 

[0018] As shown in Fig. 3, after the set of shared images 112 has been sent to the one 

or more other participating users, the sending user as well as the other participating 
user or users may then automatically be presented with a rendition of the set of shared 
images 1 12 on viewer 118. As illustrated viewer 118 may be or include a slideshow 
tool, but it will be appreciated that other types or configurations of viewer 118 may be 
used. The user currently retaining control over the mutually displayed set of shared 
images 112 on the viewer 118 of participating users may select, play, stop or 
otherwise manipulate the presentation of the set of shared images 112, using slider 
and other controls. In embodiments, the user in current control may manipulate 
remote interface elements on the viewer 118 of the remaining participants, for 
instance to move a pointer over images, attach notes, stickies or other annotations to 
images or other media objects, play or insert voice notes or otherwise mark or 
manipulate the presented set of shared media objects 112. In embodiments, 
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participating viewers may view, download or print the set of shared images 112 
presented on their respective machines. In other embodiments, access or editing 
rights to the set of shared images 112 may be limited to the user retaining control. 
Other levels or divisions of access rights to the set of shared images 1 12 are possible. 

[0019] In embodiments, that user may elect to pass control of the displayed set of 

shared images 112, for instance by messages in dialog tool 1 14 as illustrated in Fig. 4. 
The recipient may accept possession of control, for instance by receiving control 
object 1 10 (Fig. 1), such as a certificate, cookie or other token or object representing 
or activating control privileges over the set of shared images 1 12. Once control has 
passed fi*om one user to another, the user who no longer maintains control may see a 
grayed-out version of the controls of viewer 118, as shown in that figure, signifying 
^ that the other remote user or users now retain control of the realtime presentation of 

the set of shared images 112. 

[0020] In embodiments, particularly involving a group of more than two participants, 

one or more users may choose an option to "follow" another selected user, that is to 
view whatever set of shared media objects 112 that other user is actively viewing. In 
embodiments in which more than two users are actively participating, two or more 
users may in implementations select an option to remain synchronized with each 
other, constantly viewing the same set of shared media objects 112, independently of 
selections by other participating users. In further embodiments, one or more users 
may choose to "wander** or disengage from the current set of shared media objects 
1 12 mutually viewed by participants, in which case that user may elect to reenter the 
messaging session at a later point. In embodiments involving a group of more than 
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two participants, more than one control object 110 may be distributed to the set of 
users 102, a common control channel may be established in the background, or other 
control and arbitration mechanisms may be used. In such embodiments the exact set 
of shared media objects 1 12 currently loaded or viewed in each viewer 118 may be 
tracked to maintain consistency. Other viewing and control combinations are 
possible. 

[0021] Overall messaging processing according to an embodiment of the invention is 

illustrated in Fig. 5. In step 502, processing may begin. In step 504, the user or users 
having control of viewer 118 or others may select and add an image to the set of 
shared images 112, for instance using selector tool 116. Following step 504, more 
than one branch of independent or concurrent image and communications processing 
may follow, for instance by parallel execution of different threads on one or more 
machine. In step 506, a branch of executing image conversion may be initiated. In 
step 508, one or more image currently selected for or inserted into the set of shared 
images 1 12 may be converted, for instance from original file format, such as JPG, to 
another. Similarly the image may be converted in layout size, color depth or other 
parameters, for instance to generate a thxmibnail-sized representation of the selected 
image. In step 510, a nearby or successive image in a sequence of images (such as in 
a slide show) may be converted from one format, size, color depth or other parameter 
to another, for instance to facilitate transmission and viewing in the viewer 118 of 
remote users. In step 512, all images, including for instance those which are farther 
away in a slideshow, film strip or other sequence, may be conditioned or converted 
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for shared operations. Processing may then repeat, return to step 506 or other prior 
processing point or terminate. 

[0022] In step 514, a branch of image transfer processing may be initiated. In step 

516, a thumbnail or other converted representation of a currently selected image may 
be transferred from the transmitting user to the one or more other users participating 
in the messaging and viewing session, for instance via network 104 and message 
server 106, or otherwise. In step 518, the image itself (whose thumbnail 
representation was transmitted) may likewise be transferred or transmitted to 
participating users. In step 520, all remaining thumbnail representations of images 
and xmderlying images themselves in the set of shared images 112 may be transferred 
to participating users in the set of users 102, for viewing on viewer 1 18 or other tools 
or resources. Processing may then repeat, return to step 514 or other processing point 
or terminate. 

[0023] In step 522, a branch of image loading processing may be initiated. In step 

524, a current thumbnail of a selected image, instance under control of the initiating 
user or other user, may be loaded into viewer 1 18 of one or more participating users. 
In step 526, the currently selected image in the set of shared images 112 may itself 
may be loaded into viewer 1 18 of one or more participating users, for instance in the 
center of a panel in viewer 1 18 as illustrated in Fig. 3. In step 528, nearby thumbnail 
representations and related images, for instance successive images in a slideshow 
sequence, may be loaded into viewer 118 of participating users. In step 530, far away 
thumbnails and related images may be unloaded from viewer 118, for instance images 
in a slideshow sequence which are beyond the current thumbnail selection strip. 
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Processing may then repeat, return to step 522 or other prior processing point or 
terminate. 

[0024] The foregoing description of the invention is illustrative, and modifications in 

configuration and implementation will occur to persons skilled in the art. For 
instance, while the invention has generally been described in terms of one or more 
message sessions which share representations of stored images from one or more 
user's local machine, in embodiments other media, such as audio cKps, streamed 
video or other types or combinations of types of media may be incorporated. 
Likewise in embodiments the shared images or other media may be selected or 
obtained from additional or other sources, such as remote media servers or other 
resources, in client/server or hybrid peer/server fashion. 

[0025] Similarly, while the invention has in embodiments been described as 

presenting chat-style messages which reference and display the shared images or 
other media objects, in embodiments other types or formats of messaging may be 
included or also used, such as voice-channel connections or others. Other hardware, 
software or other resources described as singular may in embodiments be distributed, 
and similarly in embodiments resources described as distributed may be combined. 
The scope of the invention is accordingly intended to be hmited only by the following 
claims. 
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